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Abstract 

We apply the zero bias transformation to deduce a recursive asymptotic expansion 
formula for expectation of functions of sum of independent random variables in terms 
of normal expectations and we discuss the remainder term estimations. 
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1 Introduction 

Zero bias transformation has been introduced by Goldstein and Reinert ^ in the 
framework of Stein's method. By the fundamental works of Stein [lb\ I16j. we know that a 
random variable (r.v.) Z with mean zero follows the normal distribution N{0,a'^) if and 
only if E[Z/(Z)] = ct^E[/'(Z)] for any Borel function / such that both sides of the equality 
are well dehned. More generally, for any r.v. X with mean zero and finite variance > 0, 
a r.v. X* is said to have the zero biased distribution of X if the equality 

(1) E[Xf{X)]=a^E[f'{X*)] 

holds for any differentiable function / such that ([T|) is well defined. So combined with the 
Stem's equation xf{x) — a"^ f'{x) = h{x) — ^a{h) where /i is a given function and 
denotes the expectation of h under A^(0, o"^), we have 

¥.[h{X)] - ^^{h) = E[Xh{X) - a'f'^X)] = a'nf^X*) - f^X)] 

where fh is the solution of Stein's equation given by 

(2) fh ■■= riHt) - ^,{h))Mt)dt. 
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An important remark is that X* need not be independent of X ([Tj, see also ^). In fact, 
let W = Xi + • • • + Xn be sum of independent mean zero random variables, Goldstein and 
Reinert proposed the construction W* := W^-^^+Xj where, for any i £ {1, • • • , n}, W^^^ := 
W — Xi and X* is independent of W^^\ and I is a random index valued in {!,••• ,n} 
which is independent of {Xi, • • • ,Xn,X^, ■ ■ ■ ,X*) and satisfies P(/ = i) = af/a^^ with 
o"! being the variance of Xi and that of W. We observe that the above construction 
of zero bias transformation is quite similar to Lindeberg method except that, in zero bias 
transformation, we consider an average of punctual substitutions of Xi by X*; while in 
Lindeberg method, we substitute progressively Xi by central normal distribution with the 
same variance. 

The asymptotic expansion of expectations of the form E[/i(W^)] is a classical topic in 
central limit theorems. Using Stein's method, Barbour [H [2] has obtained a full expan- 
sion of E[/i(VF)] for sufficiently regular function h. Compared to the classical Edgeworth 
expansion (see [131 ChapV], also [14J), the results of [TJ do not require the distribution 
of Xi to be smooth; however, as a price paid, we need some suitable regularity conditions 
on the function h. The result of [Ij can also be compared to those in [9l [8] using Fourier 
transform. The key point of Barbour's method is a Taylor type formula with cumulant 
coefficients, which allows to write the difference E[VF/(M^)] — (T^E[/'(14^)] as a series which 
involves cumulants of order > 3 and to iterate the procedure of replacing ly-expectations 
by normal expectations until the desired order. It has been pointed out in [14] that the 
key formula of Barbour can also be obtained by Fourier transform. 

Zero bias transformation have been used in ^ to obtain a first order correction term 
for the normal approximation of E[/i(I^)], where the motivation was to find a rapid nu- 
merical method for large-sized credit derivatives. The function of interest is the so-called 
call function in finance: h{x) = {x — A;)+ where /c is a real number. Since such h is 
only absolutely continuous, the function is not regular enough to have the third order 
derivative. To achieve the estimation, the authors have used a conditional expectation 
technique, together with a concentration inequality due to Chen and Shao OH]. 

The main difficulty in generalizing the result in [5J to obtain a full expansion of E[/i(iy)] 
is that W and W* — W are not independent. In fact, if we consider the Taylor ex- 
pansion of f'liiW*) at W and then apply the expectation, there appear terms of the 

form K[fjl^\w){W* — W)''], where denotes the Z*'^-order derivative of /. For the 
first order expansion in [5j, the conditional expectation argument allows us to replace 
Hfh{W){W* - W)] by E[/^'(PF)]E[I^* - W] and put the covariance in the error term. 
However, in higher order expansion, the error term could no longer contain such covari- 
ances. An alternative way is to consider the Taylor expansion of E,[f'^{W*) — ff^iW)] at 
W^'^\ As X* is independent of W^^\ there is no crossing term. However, the expectations 
of theformE[/^'^(iyW)] appear, which make it difficult to apply the recurrence procedure. 
To overcome this difficulty, we propose a so-called reverse Taylor formula which enables 
us to replace E,[fjl\w^^^)] by expectation of functions of W, up to an error term. 

Let be a positive integer, X and Y be two independent random variables such 
that Y has up to N^'^ order moments, and / be an A^**^ order differentiable function such 
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that f^''\X) and f^''\X + Y) are integrable for any k = 0, - ■ ■ ,N. We define the notation 
my ^ := E[y*^]//c!. Denote by 6^(1, X, Y) the error term in the A^*^ order Taylor expansion 
of E[/(X + Namely, 

TV 

(3) 6N{f,X,Y) := E[f{X + Y)] - ^ 

A;=0 

Recall that for any > 1, 

(4) 5Nif,X,Y) = ^_l-^^\i-t)^-iE[(/W(X + ty)-/W(X))y^] dt 

provided that the term on the right side is well defined. This is a consequence of the 
classical Taylor formula in its integral form (e.g. [12j). 

The so-called reverse Taylor formula gives an expansion of E[/(X)] in terms of expec- 
tations of functions of X + y and of moments of Y. We would like to note that, in the 
expansion formula ([5]), the variables X + Y and Y are not independent. We specify some 
notation and conventions. First of all, N=k := N \ {0} denotes the set of strictly positive 
integers. For any integer d > 1 and any J = {ji)f^i G N^, | J| is defined as ji + • • • + jd, 
and my'* := my^^ • • ■mY'^\ By convention, denotes the set {0} of the empty vector, 
|0| = and mf^ = 1. 

Proposition 1.1 (Reverse Taylor formula) With the above notation, the equality 

(5) E[/(X)] = ^^(-1)'^ Yl rn^YW^'Hx + Y)]+eNif,X,Y) 

d>0 JeNd,|j|<Ar 

holds, where e]\f{f,X,Y) is defined as 

(6) eNif,X,Y) = -Y,i--^r E rn^Y^S^-\3\{f^^'^X,Y). 

d>Q J6N^,|J|<Af 

The main result of this paper is an expansion formula for the sum of independent 
random variables. We present below its formal form without giving precise conditions 
on the function and on the summand variables (this will be done in Section 3). The 
methodology appeals to the zero bias transformation. From now on, we consider a family 
of independent random variables Xi [i = 1, • • • ,n), with mean zero and finite variance 
af > 0. Let W = Xi + - ■ and a^r = Var(Ty). Denote by X* a random variable which 

follows the zero-biased distribution of Xi and which is independent of W^^^ ■.= W — Xi. 

Theorem 1.2 Assume that Xi,--- ,Xn and the function h are sufficiently good (in a 
sense that we shall precise later). Then, for any integer N > 0, E,[h{W)] can be written 
as the sum of two terms C]\fih) and e]\f{h), with CqQi) = (^^^0^) ^'^'^ £o(^) = E[/i(Ty)] — 
^a^{h), and recursively for N > 1, 

n 

(7) Cr,{h) = Co{h) + Y^afY.i-^r-' E (-xf " '^'^ 

i=l d>l JeN^,|J|<Af 
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i=l 

(8) 



-d>l 3mi,\J\<N 



N 



k=0 

where for any integer d > 1, and any J G N^, J"^ G N=k denotes the last coordinate of 3, 
and J° denotes the element in Nf~^ obtained from 3 by omitting the last coordinate. 

In view of the classical formula relating the cumulants and moments, our principal 
term C^ih) is similar to that obtained by Barbour. Note that in Cx{h), there appear 
normal expectations of iteration of operators which are of the form g i— > fg"^ acting on h. 
As pointed out by Barbour [H p. 294], such expectation can be expressed as expectation 
of h multiplied by a Hermite polynomial. 

The proof of the equality E[/i(Ty)] = Cxih) + exih) is based on the reverse Taylor 
formula and the zero bias transformation. It is important to precise the conditions under 
which all terms in the formal expansion are well defined. Moreover, we also need to show 
that ej\i{h) is "small' enough as an error term. In our results, the error term ex{h) is 
expressed in a recursive way so that it is actually a linear combination of remainders of 
Taylor and reverse Taylor formulas and can be thus estimated. A key ingredient in the 
estimation is a concentration inequality which provides upper bound for P(a < W < b) 
involving exponent < 1 of the interval length (b — a), i.e. (b — a)° with < a < 1. This 
allows to us to obtain, under relatively mild moment conditions on Xj's than those in [Ij, 
estimations for the Taylor and reverse Taylor remainders. For example, as a consequence of 
Theorem 1 1 . 2 1 and the remainder estimations, we recover a classical result, initially obtained 
by using Fourier transform, asserting that if Xi, ■ ■ ■ ,Xn are i.i.d. random variables with 
mean zero and variance a"^ > 0, which admit (2 + a)*^ order moments, then the law of 
{Xi + • • • + Xn)/\^ converges to N{0,a'^) and that the convergence speed is of order 

The rest of the paper is organized as follows. We firstly prove the reverse Taylor 
formula and the formal expansion in Section 2. In Section 3, we introduce the admissible 
function space and discuss the conditions on h and on Xj's; this is inspired by ideas in [1] 
and we can in addition include some more irregular functions. We then restate the main 
expansion result in this context. Section 4 is devoted to error estimations. Finally, some 
technical proofs are left in Appendix. 



2 Reverse Taylor formula and formal expansion 

To prove Proposition ll.il the main point is to replace E[/(I'^I)(X + Y)] by its classical 
Taylor expansion of (A^ — IJI)**^ order, so that all summand terms are of the same order 
and some of them can be cancelled off progressively. 
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Proof of Proposition 11.11 We replace E[/*^I''I)(X + Y)] on the right side of ([5]) by 

JV-|J| 

Y: m?E[/(l-^l+'=)(X)]+5^_|j|(/(l-^l),X,y) 



fc=0 

and observe that the sum of terms containing 5 vanishes with £]\f{f,X,Y). Hence we 
obtain that the right side of ([5]) equals 

iV-|J| 

d>0 JeNd,|J|<Af k=0 

If we split the last sum for k = and for 1 < k < N — \ J\ respectively, the formula above 
can be written as 

7V-|J| 

d>0 JeN^,|J|<7V d>0 Jm'i,\3\<N k=l 

We make the index changes J' = (J, k) and u = d + 1 in the second part, we find that it 
is just 

u>l J'GNjf, |J'|<Af 

Thus, the terms in the first and the second parts of ([9]) cancel out except the one of index 
d = in the first part, which proves the proposition. □ 

Using Proposition II. H we prove below the formal equality E[/i(l^)] = C]\f{h) + ej\f{h) 
by induction on A^. 

Proof of Theorem O] (formal part) The equality E[/i(W)] = Co{h) + eo{h) holds by 
definition. In the following, we assume that the equality E[/i(H^)] = Ck{h) + ek{h) has 
been verified for any k G {0, • • • , — 1} and for any good enough function h. By Stein's 
equation, E[/i(l^)] — Co(/i) is equal to 

n 

al^nfuiw*) - f'^{w)] = Ea2(E[/;;(iyW + -E[/aiy)]). 

i=l 

Consider the following Taylor expansion 

N 

fc=0 

By replacing E[/^'^'''"^^ (VF^*^)] in the above formula by its {N—kY^ reverse Taylor expansion, 
we obtain that E[/;;(VF(*) + X*)] equals 

E<' E(-l)' E '^'^'^W]+^iv-.(/r^W^^^^^) +5^U'nM"\xr). 

k=0 '-d>0 jgN^ 

|J|<Ar-fc 



5 



Note that the term with indexes k = d = in the sum inside the bracket is E[/^(VF)]. 
Therefore E[f'^{W'^'^ + X*)] - E[f'f^{W)] can be written as the sum of the following three 
parts 

n 

(10) E-xlE(-i)' E n^^SnfS'^^'^'\w)], 

k=l d>0 jgN^ Jj|<Ar_A: 

(11) ^i-ir y: m^xSfr^'\w)i 

d>l JeN^,|J|<7V 

TV 

(12) 5]m5^eA._fc(/f+^),VF«,X,) + 5jv(/;;,VF«,X;). 

fc=0 

By interchanging summations and then taking the index changes K = (J, k) and u = d+1, 
we obtain 

u>l KGNJf,|K|<iV 
As the equality m-^: = m^^. holds for any J, (fTOl) + (fTTl) simplifies as 

d>l JGNd,|J|<Ar 

By the hypothesis of induction, we have El/^I-^I+^^CVF)] = C;v-|J|(/f ^'VeTV-uK/f^'^), 
so the equahty E[/i(T^)] = CAr(/i) + eAr(/i) follows from ([7]) and ([1]). □ 



3 Admissible function space 

In this section, we describe the function set for which we can make the N^^ order 
expansion in Theorem 11.21 We need conditions on regularity and on the increasing speed 
at infinity of the function h. Actually, from ([7]) and dS]), we are concerned with the {N—ky^ 
order expansion of f^~^^^ for A; = 1, • • • , A^. So it would be natural to expect that still 
belongs to this set. Then by a recursive procedure, all terms will be well defined. 

Recall ([llj. Chapter VI) that any function (7 on M which is locally of finite variation 
can be uniquely decomposed into the sum of a function of pure jump and a continuous 
function locally of finite variation and vanishing at the origin. That is, g = Qc + 9d where 
gc is called the continuous part of g and gd is the purely discontinuous part. 

Let a G (0, 1] and p > be two real numbers. For any function / on M, the following 
quantity has been defined by Barbour in [T]: 

/.ON iii-ii \f{x)-f{y)\ 

(13) := sup- 



x/y \x-y\'^{l + \x\P + \y\py 
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The finiteness of this quantity imphes that the function / is locally a-Lipschitz, and the 
increasing speed of / at infinity is at most of order Ixl""*"^. All functions / such that 
||/||a,p < +00 forms a vector space over M, and || • \\a,p is a norm on it. We list below 
several properties of || • \\a,p, which will be useful afterwards and we leave the proofs in the 
Appendix lAl 

Lemma 3.1 Let f be a function on R, a, /3 £ (0, 1] and p,q > 0. 

1) Ifp < q, then \\f\\a,p < +00 implies \\f\\a,q < +00. 

2) Ifa< (3, then \\f\\p,p < +00 implies \\f\\a,p+i3-a < +00. 

3) If P is a polynomial of degree d, then ||/||a,p < +co implies \\P f\\a,p+d < +00. 

4) Assume that F is a primitive function off, then ||/||o,p < +00 implies ||i^||i^p+a < +00. 
(Hence ||F||a^p+i < +00 by 2).) 

Inspired by [Tj, we introduce the following function space. 

Definition 3.2 Let > be an integer, and a S (0, 1], p > be two real numbers. 
Denote by Hap the vector space of all Borel functions h on M verifying the following 
conditions: 

a) h has N^^ order derivative which is locally of finite variation and which has finitely 
many jumps, 

b) the continuous part of h^^^ satisfies ||/ic^^||a,p < +00. 

Condition a) implies that the pure jump part of h^^^ is bounded. Condition b) implies 
that /ii^'' has at most polynomial increasing speed at infinity, therefore also is h. These 
conditions allow us to include some irregular functions such as indicator functions. Let 
/c be a real number and Ik{x) = l.^x<k}- Then ||/a;||q.,p is clearly not finite. However, 
||-^fc,clU,p = 0) which means that for any a G (0, 1] and any p > 0, /fc(x) G 'H% p. Note that 
any function h in W^^p can be decomposed as /i = hc + hd, where he satisfies ||/ic||«,p < +00, 
the discontinuous part h^ is a linear combination of indicator functions of the form IL{x<fc} 
plus a constant (so that /ic(0) = 0). 

Proposition 3.3 Let N > be an integer, a, (3 G (0, 1] and p,q > be real numbers. 
Then the following assertions hold: 



1) when N>1, he H^^p if and only if h' G H^'^; 

2) ifp< q, then H^^ C W^,; ifa<P, then H^^ C H 



'a,p+f3—a' 



3) when N>l,n, 



c n 



l,a+p 



cn, 



a,p+l' 
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4) if he nZ,p and if P is a polynomial of degree d, then Ph G 'hi^„,^- 

Proof. 1) results from the definition. 2), 3) and 4) are consequences of Lemma l3. II □ 

The following result on the operator h ^ fh is fundamental. It shows that compared 
to h, the solution of Stein's equation fh has one more order in regularity and its derivative 
has the same order in increasing speed at infinity. The proof of this proposition, which is 
rather technical, is postponed to Appendix iBl 

Proposition 3.4 Assume that h E n^p. Then fh S 

We now restate Theorem 11.21 in the function space context. 

Theorem 3.5 Let N > be an integer, a £ (0, 1] and p > 0. Assume that h £ n^p. Let 
Xi, • • • , Xn he zero-mean random variables which have (A^+max(a+p, 2))*^^ order moment. 
Then all terms in ^ and ([8]) are well defined, and the equality E[/i(VF)] = C^ih) + eAr(/i) 
holds. 



Proof. When N = 0, h e H^^p and then h{x) = 0(|x|"+p). Hence E[h{W)] and ^awW 
are well defined. Assume that we have proved the theorem for 0, • • • , — 1. Let h G 'H^p. 
Then by Proposition [331 h{x) G C • • • C K,p+7V> so = 0(1x1"+^+^). By 

Proposition [321 fh G ^ and by Proposition [331 1), for any | J| = 1, • • • , A^, /^'^^'^^^ € 
W^p'"^'. So the induction hypothesis implies that Cjv-|j|(/^''^''''^^) and ejv-|j| (Z^'"^'^^^) 

exist. Furthermore, for the terms e^-k and 6n in ([8]), since f^^'^\x) = 0(|x|"'*'^^^~^) 
for any /c = 0, • • • , A^, they are well defined. Finally, combined with the equality 



E[(A- 



all moments figuring in d?]) and ^ exist. Thus all terms are well defined, and the formal 
proof in the previous section shows that E[/i(Ty)] = C^ih) + e]y{h). □ 



4 Error estimations 

4.1 Concentration inequalities 

We shall prove some concentration inequalities similar to several results in [3l H] , which 
give upper bounds for probabilities of the form P(a ^ ^ 6) with a and b being two real 
numbers. We shall take into consideration the parameter a and give some variants where 
appear certain lower order moments if a < 1. When a = 1, we recover some estimations 
in [5] . These concentration inequalities will be useful to estimate the approximation error 
terms and the proof is based on the zero bias transformation. 
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Lemma 4.1 Let a £ (0, 1] be a real number and X be a r.v. with mean zero, finite variance 
(T^ > and up to {a + 2)*^ order moments. Let X* have the zero biased distribution of X 
and be independent of X. Then, for any e > 0, 

p(|x -x*\>e)< — — —mxT^% 

where X" = X — X and X is an independent copy of X. 

Proof. Similar to the Markov inequality, the following inequality holds: 

P(|X - X*| > e) < ^E[|X - 

Moreover, since X and X* are independent, the definition of the zero bias transformation 
(see [SI Pro2.3]) implies that 

□ 



Proposition 4.2 Let Xi {i = 1, ■ ■ ■ ,n) be independent random variables with mean zero 



and variance af > 0. Let W = Xi + • • • + Xn and denote its variance by a?y. For a,b & 



such that a < b and any real number a G {0,1], we have 

(14) P(a < ly < 6) < 2 ( ^) % ^ V E [I ^ I "+^1 + f E ' • 

1=1 ^' 1=1 

Proof. Let I[a^b]{x) = 1 if x G [a, 6] and I[a^b]{^) = otherwise. Its primitive function 
/(^) •= /(a+fe)/2-^M(*)^* satisfies |/(x)| < (6- a)/2. Then 

E(/m(^*)) = -^nWfiW)) < min 

Note that for any u >0 and any a G (0, 1], min(n, 1) < Then for any e > 0, 

'b- 

2aw 



F{a-e<W* <b + e)< 



law ) ~ \2o-w J \(yw ) 



where the last inequality is because for any u and v positive, one always has {u + v)" < 
It" + ii". On the other hand, by using a conditional expectation technique. 



P(o-e < VF* < 6 + e) > P(a < < b,\Xi - X}\ < e 

1 " 4 

>na<W< b)¥{\X} -Xi\<e)--(Y^^ 
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We recall that W* = W^^^ + X} where / is a random variable taking values in { 1 , • • • , n} 
with P(/ = i)= crf/a^, W^'^ ■.= W- X„ X* has the zero biased distribution of Xi and is 
independent of W^'^\ In this proof exceptionally, we assume that X* is also independent 
of Xi. By Lemma liJ] 



F(|xi -xj\<e) = i-Y: ^n\x: -x,\>e)>i- ' Yl n\x: 

Finally, the inequality (|14|) follows by taking 



□ 



Corollary 4.3 Let a, 6 G M such that a <b and i £ {1, • • • , n}, then 



P(a < iy« < 6) < 4(^)% 4t E^fl — ri + ^(E-/)^ + <- ' 
w/iere VF^ = 



Proof. Let e > be a real number, then 

P(a < l^W < 6, < e) < P(a - e < < 6 + e). 
Note that VF^*) and Xi are independent and 

P(|X,| < e) = 1 - P(|X,| > e) > 1 - 
By Proposition 14.21 and taking e = 2E[|Xj|], we obtain the inequality. □ 



4.2 Estimations of error terms 

In this section, we shall estimate the error term ejsf^h) in Theorem 13.51 The recursive 
formulas ([H]) and ^ permit us to reduce the problem to the estimation of classical Taylor 
expansion errors. 

For any positive random variable Y and any real number /3 > 0, we introduce the 
notation m^f^ := E[y^]/r(/3 + 1), where F is the Gamma function F(x) = f'-^e-^dt. 
This notation generalizes the one introduced in since when /3 € N, F(/3 + 1) = /?!. 
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Proposition 4.4 Let N >0 be an integer, a £ (0, 1] and p > be two real numbers. Let 
X be a random variable which has up to {N + a+pY^ moments and satisfies the following 
concentration inequality 

¥{a<X<b)< c{b - a)° + r, Vo, 6 G M, a < b, 

where c and r are two constants. Let Y be a random variable which is independent of 
X and has up to {N + a + p)*^ moments. Then, for any function g E T~i^p and any 
k = 0,--- ,N, 



(15) 



|5^_.(,W,X,y)| < Vig^f^)(cm\^-'^'^^+rm\^-'^ 



"lYl ^ ' ""lYl 

II (AT) II / (N-k+a) (N-k+a+p) 

' \\9c \\ci,p\^a,p,X'^^Y^ I '^a,pfTT'^Y\ 



where V{g^^^) denotes the total variation of g^\ the coefficients Ua,p,x md Va,p are 
defined as u^^p^x = (l + (1 + 2P)'E[\X\p])T {a + 1) and = 2PT{a + p+ 1). 

Proof. We have by dH) that when k < N, 

S^^,{g^'^\x, Y) = j\l - tr'^-'^[{g^^\x + tY) - g^^Hx))Y^-^] dt. 

Since g G H^p, the function g^^^ can be written as 

^<j<M l<j<M 
Kj>0 

Therefore, gf\x + tY)-gf\x) = EfUejlK,-tY+<x<K,-tY., where Y+ = max(y,0) 
and y_ = min(y, 0). Thus the concentration inequahty hypothesis imphes that 

M 

E[\g<f\x + tY)-gl,''\x)\ \Y] <Y^\e^\{ct^\Yr + r) . 
Moreover, one has 

•^0 1 j=i j=i 

by using the following equality concerning Beta function 

B{x,y):= f\--\l-t)y-'dt=^^P^, x,y>0. 
Jo ^{x + y) 

On the other hand, by definition of the norni || • Ha^p, W6 have 

|gf )(X + tY) - < Wgf^ \\a,p\tY\"il + \X + tY\P + \X\p) 

< \\9i^^h,p\tY\''{l + (2P + l)\X\P + 2P\tY\P), 
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where the last inequahty results from (a + b)^ < 2^{aP + W). Note that 

1 ^^_^^7V-fc-l 



{N-k-l)\ 



E 



|tyr i+(2P+i)|x|p+2P|ty|p)|y 



N-k 



_ (N-k+a) (N-k+a+p) 



Thus we obtain the estimation (llSp . 

Finally, it remains to check the case when k = N. Consider the continuous and dis- 
continuous parts of 6o{g^^\ X,Y) = E[g^^\X + Y) — g^^^X)] respectively. By using 



similar method as above, we obtain that E[|5^ '{X + Y) — g^^ 1^V{g^ 



e.ndE[\gf>{X+Y)-gf>{X)\] < Uc'lUp (^[1^11(1 + (2^ + m[\X\P]) + 2fE[|yr+f]), 
which implies ()15p . □ 



By Proposition 11.11 and Proposition 14. 4^ we obtain the error estimation for the reverse 
Taylor expansion. 



Corollary 4.5 With the previous notation, we have 



\eNig,X,Y)\<Y^ 



m 



(J) 



(16) 



d>0 JeNd,|J|<Ar 



V{gf%m 



{N-\J\+a) 

\y\ 



AN-\J\)^ 



^ Wile \\ci,p\"'a,p,X'"'^Y\ I ^a,p'"'^Y^ ) 



Combining the concentration inequality (Corollary 14. 3p and the above estimations 
(Proposition 14.41 and Corollarv 14. 5p . we obtain upper bounds for the Taylor and reverse 

Taylor remainders dN-kifh'^ ^^id £N-k{f^\ Xj), where the summand vari- 

ables Xi, • • • , Xn are independent. This allows us, together with the recursive formula (l8|), 
to obtain an upper bound for the asymptotic expansion remainder e^ih). 

In particular, we give in the following the order estimation of e^ih) when Xi, • • • , X„ 
are in addition i.i.d. random variables. 

Proposition 4.6 Suppose that Xi,--- ,X„ are i.i.d. random variables with mean zero 
and up to {N + 2 + a + py^ order moments, normalized such that each Xi has the same 
distribution as Zj y/n where Z is a fixed random variable with mean zero and finite non- 
zero variance. Then for any function g e 'H^p and any k = 0, - ■ ■ ,N, we have 




where W^'^^ = W — Xi and X* is independent of . The implied constants depend on 
\\9c^''\\a,p, ^idd^'') up to {N — k + 2 + a + pY^ order moments of Z . 
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Proof. By Corollary 14.31 we have for any a < b and any a £ (0, 1] that 

P(a < < 6) < c{b - a)° + r(n) 
where the coefficients are given by 

_ 22-° 4 E[|Z^|°+2] 1 8 

By Proposition 1331 we obtain an upper bound of 6i\f-ki9^''^ > W^^\X*) which is determined 
by a linear combination of terms (with coefficient not depending on n): 

(19) r{n)m\^-'\ E[|T^»r]m[J-'=+") and m[J-'=+"+^). 

Note that r(n) = 0((1/VH)"). For any A: = 0, • • • , iV, E[\X*\^] equals E[|Xi|'=+2]/(a2(A; + 1)) 
and is of order {l/^/n)^. So the first three terms in ()19|) are of order {1/ ^/n)^~^~^°' and 
the last term is of order {l/^/n)^~^~^°'~^^, which implies the ffist assertion. The second 
assertion then follows by Corollary 14.51 

□ 



Remark 4.7 According to (jlSp and (jl6p . the implicit constants in (jl7p and (jlSp can be 
explicitly calculated. 

Proposition 4.8 Let N > be an integer, a G (0, 1] and p > be two real numbers. Let 
h be a function in TL^p, and Xi, - ■ ■ ,Xn be as in Proposition \4.6\ Then the error term 
e]\f{h) defined in ([8]) satisfies 

/ / 1 \ N+a+p 

ejv(/i) =0 



71/ 

th 



where the implied constant depends on up to (N + 2 + q + p) order moment of Z. 
Proof. We prove the theorem by induction on N. When = 0, 

n 

1=1 ^ 
Since h £ p, A e Wi,p- Then by Proposition eo{h) = 0((1/^)"+p). 

Assume that we have already proved the theorem for 0, • • • , N — I. Consider h G Ti-^p and 
CNih) defined as in 1^. For any J such that 1 < |J| < N, eAr„|j| = 0((1/V^)^-I-^I+"+p). 
In addition, since |J°| + |J^| = |J|, we have that ml^. '*(m^,^ ^) order {l/^/n)^^^^. 

On the other hand, //^ G W^^, so 57v(/^ W^^'^ AT*) = 0((1/V^)^+°+p). Moreover, for 
any k = 0, • • • ,Ar, G So e^-fc(/l'+'\ A*) = 0((l/^)^-'=+"+?'). 

Finally we have m^yl = 0{{\/ ^/n)^). Combining all the above estimations, we prove the 

i 

proposition. □ 
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Consider now several examples. Let Ik{x) = Tl^x<k} be the indicator function. As 
mentioned before, G T~(-aO- Proposition 14.81 we know that if Xi,--- ,X„ are i.i.d. 
random variables with up to (2 + 0;)*''^ order moment, then eo(/i) = 0((l/-^/n)"), where the 
coefficient depends on up to (2 + a)**^ moment of the summand variables. This is similar 
to a result (Theorem 6) in [T31 §V.3]. When a = 1, it corresponds to the order estimation 
in the classical Berry-Esseen inequality. 

Let h{x) = (x — be the call function discussed in [5j. As a primitive function of 
the indicator function, we know that h G W^g. So the call function admits a first order 
expansion given by ([7]) as: 

n 

C,{h) = ^^^{h)+^afE[X*]<!>^^,.{f'^). 

i=l 

Moreover, since a'^^awifh) = ^^wi^f'h) = ^'^aw{i^ - ^)xh{x)). We recover the 
correction term in 



A Proof of Lemma 13.1 



Proof. For the first two assertions, it suffices to prove respectively the boundness of the 
following two functions 

l + \x\P + \y\P . .g_^ l + \x\P + \y\P 



1 + \x\i + \y\'i ' ^' 1 + + |y|P+^-°' 

These functions are both continuous on M, therefore are bounded on any compact subset 
ofM^. Thus we may assume without loss of generality that r = y'x^ + y^ > 1- In this 
case, max{|x|, \y\} > r/\/2, so 

l + \x\P + \y\P l + 2rP „,2 



q 



1 + 1x15 + 1^19 - l + {r/V2) 

u _ l + \x\P + \y\P ^ (2r)'^-'^ ^ ^ < 3 . 2(P+3/3-3a)/2 

' ^' 1 + \x\P+^-°' + \y\P+^-°' - ^ ' 1 + (r/^/2)P+/5-" ~ 

3) One has 

\P{x)f{x)-P{y)f{y)\ ^ (l + |x|P + |y|P)P(x) „^„ \f{y)\-\P{x)-P{y)\ 



\x - + |x|P+'^ + \y\P+'^) ~ 1 + \x\P+'^ + \y\P+'^ " " \x - + \x\p+'^ + \y\P+'^) ' 

By using the argument as in the proof of 1) and 2), we obtain that the first term in the 
right-hand side is bounded. Since P is a polynomial of degree d, there exists a polynomial 
Q{x,y) in two variables and of degree d — 1, such that Q{x,y) = {P{x) — P{y))/{x — y). 
Therefore, the second term equals 

\Q{x,y)\-\x-y\^-^-\f{y)\ 
1 + \x\P+'^ + \y\P+'^ 
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which is bounded by a similar argument as for proving 1) and 2). 

4) Since ||/||a,p < +oo, <C 1 + Itl""*"^. Therefore, for x,y G M, x < y, one has 



\F{x) - Fiy)\ < r \fit)\ dt « r (1 + |tr+P) dt<{l + |xr+P + \y\ 

J X J X 



\Fix) — F{y)\ 

Hence ■; r- — ;— r-;— — r is bounded. □ 



\x - y\{l + |a;|P+" + \y 



B Proof of Proposition 13.4 



We now prove the Proposition 13. 4i Let h € 'H^p. The function is one more order 
differentiable than h and is hence + 1 times differentiable. Taking N^^ order derivative 
on both sides of Stein's equation, we get 



[X]. 



(20) (xA(x))W-aVf"'^)(x) = /.W(. 

The function {xfh{x))^^^ is continuous, so ff{^~^^^ is locally of finite variation and has 
finitely many jumps as h^'^^x) does. In the following, we shall prove ||/^^^^^ < +oo. 

Definition B.l Let A be an interval in M and / be a Borel function on A. For any 
a G (0, 1] and p > 0, we define 

(21) ll/L^:=sup \f(-)-f('^)\ 



,4 Ix-yl'il + lxlr + lylPy 

x,y&A 

This definition is analogous to (I13p . restricted to an interval. When A avoids an open neigh- 
borhood of 0, then the finiteness of ||/||a^p is equivalent to that of sup x^y \x-y\'^(\x\p^+\y\p) ■ 

x,y£A 

This property does not hold for the norm defined in p3|) . As a consequence, we 

have the following result. 

Lemma B.2 Let A C (— oo, —1] U [1, +00) be an interval, a E (0, 1] and p ^ 0. Let q 
be a real number such that ^ q ^ p. Then for any Borel function f defined on A, 
WfWtp < +00 if and only if < +00. 

Proof. If g < +cxd, then by similar arguments as for proving Lemma 13. H 

we have < +co. We now consider the converse assertion. Firstly, there exists a 

constant C > such that |/(x)| ^ C|x|°^p for any x £ A. For any x,y £ A, \x\ < \y\, 

\f{x)x<^-^ - ^ , Ix^-P - y^-Pl , \f{x)-f{y)\ 



X - + Ixl? + ' ' " |x - y|°(l + Ixl? + lyl'?) |x - y|"(l + Ix]"? + 
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The second term is finite since 



l/(^)-/(y)l < _u,uA 



\x - y\°'{\y\P~'^ + \x\i\y\P-i + \y\P) ~ \x- y|"(l + \x\p + \y\P) " ""'P' 
By the mean value theorem, the first term is bounded by 

^, • • \x\'^-P-^ 

|x - y|"(l + + 

and thus by C\q — p\ if we assume in addition that \y\ < 2\x\. When \y\ ^ 2|x|, one has 

Irl-P — ifl~P\ |rl"+P|rl'J~P 
^7^ ' , , , < C ' ' , '7 ^ C. 

□ 

The following lemma allows us to consider the estimations on several disjoint intervals 
respectively. 

Lemma B.3 If A = AiU A2 where Ai and A2 are two intervals such that Ai Ci A2 ^ 0, 
then 



sup{||/||^:„ \\f\\i%} < WfWi, < 2(11/11^,^, + II ^11-^^ 



Proof. The first inequality is obvious. For the second inequality, we only need to prove 
for any x £ Ai and y £ A2 that 

^ ^ni fiiAi , \\ f\\A2 \ 



\x - y|"(l + \x\P + \y\P) - ^"^ ""'P "■' ""'P' 

Without loss of generality, we may suppose that Ai f] A2 contains a single point z. Then 
\f{x) — f{y)\ < |/(a^) — f{z)\ + \f{y) — f{z)\. In addition, since z is between x and y, we 
have |x — y| > max(|a; — z\,\y — z\) and \x\p + \y\P > ^ max{\x\P + \z\p, \y\P + \z\p). So 

\f{x)-f{y)\ \f{x)-f{z)\ ^ \f{z)-f{y)\ 



\x - y\°'{l + \x\P + \y\P) ~ \\x- z|°(l + \x\p + \z\p) \z - + \z\p + \y\i 
which implies the second inequality. □ 

Lemma B.4 If h £ n^^, then H/^^^^^ < +00 for any bounded interval A. 

Proof. Firstly, for any bounded interval A and any Borel function g, \\g\\a^p < +00 if and 

only ii g is a-Lipschitz on A. We examine Z^^"*"^^ using ([20|) . Since h S "H^p, hi^'^ is locally 

a-Lipschitz. The function {xfh{x)Y'^'^^^ = xf^^'^\x) + {N + \)f^\x) has finitely many 
jumps. Hence {xfh{x))^^^ is a primitive function of a locally bounded function, thus is 

locally 1-Lipschitz. So by (I20p . fjf^^'^^^ is locally a-Lipschitz, which implies the lemma. 
□ 
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Let Ai = [—1,1], A2 = (— 00,— 1] and ^3 = [l,+oo). Lemma \B.3\ shows that to prove 
thefinitenessof ll/^^"^^^!!, it suffices to prove respectively the finiteness of ll/^^"*"^^ ||^^^, (i = 

1,2,3). Lemma [6.41 shows that ll/;^^''^^^ ||L,p'^' < +00. So it remains to deal with fjfl'^^^ 
on the set ^2 U = M \ (— 1, 1). To this end, we introduce a "modified" Stein's equation 
as in [51 Appendix]: 

(22) xh{x)-a^f'f,ix) = h{x), xGM\(-l,l) 



whose solution is given by 
(23) Mx) 



Working with (j23p . it will be easier to treat the derivative functions. In fact, in ([2]), the 
integrand function h — ^aih) is centralized under the normal expectation. However, it is 
not the case when taking derivatives. This is one reason why we introduce (j22p . Note that 
in general, the right-hand side of ()23p can not be extended as a continuous function on 
M, except in the special case <l*o-(/i) = where we recover the solution of classical Stein's 
equation. 

To study fh, we introduce the function space £„: for any a > 0, let S^j be the space 
of all Borel functions /i on M \ (—1,1) such that J^^^^^ \h{x)P{x)\4)o-ix)dx < 00 for any 
polynomial P. Note that is a vector space which contains all Laurent polynomials (that 
is, polynomials in x and x~^) and is stable by multiplication by Laurent polynomials. 
Furthermore, as shown by the lemma below, it is invariant by the operator h ^ fh- 

Lemma B.5 Let h €z S^- Then the function fh is well defined and ft & Sa- Furthermore, 
if H is a primitive function of h, then H £ So-- 



Proof. Let P be an arbitrary polynomial on M. Then 

-j^ POO f-OO -j^ 



\P{x)fh{x)\Mx)dx <^ dx\P{x)\ J \h{t)\(t>o{t)dt = ^ dt\h{t)\^o{t) \P{x)\dx- 

There exists a polynomial Q such that \P{x)\ dx < Q{t) for any t > 0. Therefore, the 
fact that h £ £0 implies that \P{x) fh{x)\(po{x) dx < +00. The finiteness of the integral 
on {—00, 1] is similar. The second assertion can be proved by integration by part. □ 



Remark B.6 Note that fh is the only solution of (j22p in provided that h £ 

More generally, for the derivatives of fh, we consider, for any integer > 1, the set 
£^ which contains all functions h such that h is N times differentiable on R\ (—1, 1) and 
that h^^^ £ Efj. It is not difficult to observe that h G if ^i^^l only if it is a primitive 
function of an element in S^^^ ■ The relationship between £^ and Ti-ap is as follows. 
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Lemma B.7 If h & '^a,p! ihen the restriction of h on M. \ (—1,1) is in £^ . 

Proof. It suffices to show tliat the restriction of h^^'^ on M\ (—1, 1) is in £„. This is obvious 
since /li^^ has at most polynomial increasing speed at infinity. □ 



Definition B.8 For any derivable function /i on R \ (—1, 1), define the operator 

(24) mix) := (^y. 

Lemma B.9 If h £ then A(/i) G S^^. Furthermore, we have the following equality: 

(25) J'h{x) = xj^h){x). 

Proof. By definition, A(/i)(x) = h' {x) / x — h{x)Jx'^ , so A(/i) G E^j. To prove the equality, it 
suffices to verify that the function u{x) := x^^f'i^{x) satisfies the equation ([22]) for A(/i) (see 
Remark above). In fact, if we divide the both side of the equation x fh{x) — a"^ f'j^{x) = h{x) 
by X and then take the derivative, we obtain xu{x) — a'^u'{x) = A{h){x). □ 

Lemma B.IO If h £ and if I is a real number such that h{x) = 0{\x\^), then fh{x) = 
0(|x|'-i). 

Proof. Recall that (^ LemA.l]) if |/i(x)| < g{x) and if g{x)/\x\ is decreasing when x > 
and is increasing when x < 0, then \fh{x)\ < g{x)/\x\. Hence, we prove the lemma for the 
cases where I < 1. By Lemma lB.91 one has 

f\x\'ix) = x~'^{\x\^ + (r'^fl^iiix)) = sgn(x)|x|'-^ + cr'^fA{\x\')ix) 
= sgn{x)\x\^''^ + a^(l - l)/[^|i-2(x). 

Thus, /|a;|!-2 = 0(|x|'~^) implies = 0(|x|'~^). Hence by induction on /, we obtain the 
result. □ 



Remark B.ll With the notation of Barbour fl], the equivalent expectation form of fh 
is given by 



Zx 



§^E[h{Z + x)e ^l{z>o}], x>0 
^E[h{Z + x)e~^l{z<o}], x<0 



(26) fhix) = 

where Z N{0, o"^). So the above lemma can be interpreted as : the function 



^Khz>o}iZ + xy^'e~^\ 
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is bounded on [1,+cxd). We can then deduce easily the fohowing assertion : for alH G M 
and m G M+, the function 

— ^ 

is bounded on [1, +00) by using the fact that the function u"^e 2^ is bounded on [0, 00). 

We give below the relationship between the derivatives of fh and of h. In the following 
two formulas, the first one computes using the operator ()24p and the second one 
expresses A^[h) using derivatives of h. Their proofs are by induction, which we omit in 
this article (interest readers may refer to [10^ p. 144-145]). We only remind that the first 
formula is a generalization of (j25p . 



Lemma B.12 If h G £^ with N being a strictly positive integer, then 

\_N/2\ 



I — n \ 



)!!x^-2'=/a--.(,)(x); 

fc=0 

N 



(28) A^(/.)(x) = j;(-l)'=(2A:-l)!!r 

fc=o ^ ^ 



xN+k 



where we have used the convention (—1)!! = 1 and [A^/2j denotes the largest integer not 
exceeding N/2. 

Remark B.13 1) For any function h G £^ , the above results also hold for ff^\x) and 
N^{h) where 1 < m < N. As the operator /i — > //j is linear on h, the above lemma 
enables us to write the derivatives of fh as a linear combination of derivatives of h with 
Laurent polynomial coefficients and then to deduce their increasing speed at infinity. 

2) The derivative function has to be treated differently. In fact, we can no longer 

apply ([28]) to A^+i(/i) since h^^^^^ does not necessarily exist. We separate the first 
term where A: = in (j27p from the others and then take the derivative to obtain 

S''^'^=^^/;-(.)(^)+ E (2^)(2fc-l)!!(A^-2fe)x^-^^-VA--(.)(-) 

L7V/2J 

x) 



+ E (f,)(2^-i)nx---7v. 

L(^+1)/2J . . 

k=i ^ ^ 

This will be a crucial point in the proof of Proposition IB.lSi 
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Lemma B.14 Let h be a Borel function defined on A2UA3 = IR\(— 1, 1). < +00 

where A = A2 or A^, then, for any integer n ^ 0, one has 



A/a;"lla,p < + 



00, 



fh/x"\\a,p < +00. 



Proof. We only prove for A2 and the case for A^ is by symmetry. Let g{x) = h{x)/x^. 
Assume that x and y are two real numbers such that 1 ^ x < y. Then one has 



\x - + \x\P + \y\P) 



E 



'{z>0}- 



(Z+x)" ^ {z+yy^ 



\x - + \x\P + \y\P) 



which can be bounded from above by the sum of the following two terms 



(29) 



(30) 



E 



\h{Z + x) - h{Z + y)\ 



,n+l 



E 



^^>°^|x-y|°(l + |x|P + |?/|P) (Z + y)" 
I{z>o}\KZ + X 



„ Zy 

e 



ri + l r/" + l — ^ 



{Z+x) 



{Z+yr 



\x - y|°(l + \x\P + \y\- 



Note that (j29[l is bounded from above by 



'{Z>0} 



{Z + yY 



e a 



Zy 



By Lemma IB.lOt this quantity is bounded. We then consider the upper bound of (I30p 
under the supplementary condition that y ^ 2x. As < +00, there exists a constant 

C > such that h{x) ^ C|x|""^^. By applying the mean value theorem on the function 

n-\-l i -I I 

(z+xr ^~^ the fact that \x - y\'^~^{l + \x\p + \y\P) > where a < 1, 



3QD ^ 



27r, 



n+l 



V (Z + x)" (Z + x)"+i a'^{Z + x) 
C^|x|i-"-p|(2"- (n + l) + 2"+i •n)E[/|^>o}(^ + ^)"+^e" 



Zx _ 



2"+^E 



Zx I 



<C X 



which is bounded (see Remark lB.lip . In the case where y > 2x, one has x^~^^ /{Z+x)^ < x 
when Z > 0, and \x — y|"(l + \x\p + \y\P) > max(|x|"^^, (|)" • y^), so 



HDD ^ C 



1 



a [2|x|"+P-i 
which is bounded. 



E 



I{z>o}iZ + xr-^Pe 



+ 



\a+p—l 



E 



I{z>o}{Z + yr+^e 



.Zy 



□ 
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We now give the final part of the proof. 



Proposition B.15 Let N ^ be an integer, a £ (0, 1] and p ^ 0. Let h be a function 
defined on A2 U A3 = M \ (—1,1) which is N times dijjerentiable and such that h^^^ is 
locally of finite variation, having finitely many jumps and verifying Whi'^^W^^p < +00 where 
A = A2 or A3. Then the function fh is N + 1 times differentiable, is locally of 

finite variation, having finitely many jumps and verifying \\Th^^^\\a,p < +00. 

Proof. The function //j is + 1 times differentiable by ()20p . is locally of finite 

variation, having only finitely many jumps. By virtue of Lemmas IB. 31 and IB. 41 it suffices 
to prove 

for sufficiently positive number h. Therefore, without loss of generality, we may assume 
that h^^'^ is continuous and hence Z^^"*"^^ is also continuous. 

By Remark lB.131 2). the function Th^^^^ can be written as a linear combination of f. 



and terms of the form x'^+^^'^''fjyN+i-k(^h)ix) where k = l,-- - , [^J . By x^f'^,,^^^ 
itself is also a linear combination of f'j.^(^N-i) j^N+i 

where i = 0, • • • ,N. As ||^ < 00, 
we have, similar as in in Lemma O 4), that \\h^^~'-''\\t,p+i < +00. Hence \\h^^~'^ /x'\\^^p < 
00 by Lemma TB. 21 and Lemma [6.141 then implies that ||a;^/^(jv-i)y^jv+i llo,p < 00. 
The terms 2;^+^~^'^/^jv+i-fc(^)(x) are also, by ([28]) again, linear combinations of the func- 
tions of the form 3;^+^~^'^/^{jv+i-fc-,)/^jv+i-fe+,. By a similar argument as above using 
Lemma lB.21 \\h^^~^^~^~^^ /x^'^'^'^^W^^p < 00. Finally, we apply Lemma [B.14I to obtain 
\\x^~^^'^''ff^(N+i-k-i)/^N+i-k+i\\a,p < 00, which completes the proof. 

□ 
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